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@ Moving picture coding method and an apparatus therefor. 

@ A moving picture coding apparatus for compressing moving picture video signal to a target amount 
"TARGET" which has an optimized size to properly fit in a disc. The moving picture video signal is divided into 
a plurality of groups of pictures (GOPs), each GOP has a plurality of frames. During a first cycle operation, the 
video signal is compressed by DCT unit (405) and quantizer (406) using a fixed parameter from a content 
generator (708), and the following amounts are measured: compressed data amount "GOP(i)" in each GOP; 

compressed data amount "Frame(j)" in each frame; and compressed, data amount "GOP ^Total" in total GOPs. 

Using these measured amounts, appropriate size for eiach frame is calculated in a calculator (705). Then, in the 
second cycle operation, ttie video signal for each frame is compressed according to the calculated appropriate 
size, and recorded on a disc. ' 
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BACKGROUND OF THE INVENTION 

1. Field of the invention 

5 The present invention relates to a moving picture coding method, and to a moving picture coding 

method appropriate to a moving picture coding recording and reproducing apparatus. 

2. Description of the prior art 

70 Numerous technologies have been developed in recent years for processing digitized moving pictures, 

including various methods of compressing and thereby reducing the amount of image data. Digital image 
compression is needed for efficient recording and transmission of digital moving pictures because of the 
inherently large amount of information resulting from the digitizing process: The extremely large volume of 
information recorded on digital video disks storing movies and similar subject matter, for example, 

75 necessitates efficient moving picture coding and decoding technplogies. 

One known moving picture coding method uses time base correlations to compress the image data, 
and may use specific correlations within or between image frames. Compared with intra-frame coding, 
coding using inter-frame correlations can achieve a higher compression rate, but when errors occur, a 
refresh operation for intra-frame coding at a predetermined cycle must be executed because the data is 

20 propagated on the time base. 

Fig. 1 shows the relationship between predictive frames and processed frames in a method compress- 
ing moving pictures using time base correlations. There are three different kinds of frames, which are Intra 
frames I (l-picture frame or frame I), bidirectional interpolated frames B (B-picture frame or frame B) and 
predictive frames P (P-picture frame or frame P), which are produced in a pattern I.B.BP.B.B, repjeatedly, 

25 as shown in Rg. 1. The frame I includes one complete data for one frame and can reproduce one franhe 
picture by itself. The frame B includes data for one frame, but can not reproduce one frame picture by 
itself, but references the data from frame I and frame P. Similarly, the frame P includes data for one frame, 
but can not reproduce one frame picture by itself, but references the data from frame P. Frames 1 are 
compressed using only the data correlations within that frame, and are used as the predictive frames when 

30 processing frames P and B. Frames P are coded by referencing the preceding frame I or the preceding 
frame P as the predictive frame. Frames B are coded by referencing, as the predictive frames, frames I and 
P before and after frame B. and the interpolated image generated from said frames I and P. The numbers 
following each coding type (I, B, P) indicate the display sequence of each frame in the chronological order. 
For example, frame 1-0 is a type I frame in display sequence 0. 

35 Fig. 2 shows the frames shown in Fig. 1 rearranged in the order pir-ocessed. Frame coding starts with 
frame 1-0, followed by frame P-3 using the already-coded frame 1-0 as the predictive frame.-Jframes B-2 and 
B-1 are then frame interpolation coded using as the predictive frames the already-coded frames 1-0 and P- 

3. and an interpolated image generated from frames 1-0 and P-3. Frame 1-6 is then cpded by intra-frame 
coding, and friames B-4 and B-5 are frame interpolation coded using as the predictive frames the already- 

40 coded frames P-3 and 1-6. and the interpolated image generated from frames P-3 and 1-6. The coding 
sequence of each frame is thus determined based on the type of coding appjied. Frame groups of plural 
frames are also defined as the processing unit for the coding operations, and are the data unit accessied for 
editing and special reproduction modes. In Figs. 1 and 2, the first group of pictures GOP1 comprises 
frames 0-3, and the second G0P2 comprises frames 4-9; each of the subsequent GOPs similarly 

45 comprises six frames. 

Rg. 3A shows the target coding level assigned to each GOP when coding each GOP in the sequence 
shown in Fig. 2. In a system manipulating moving pictures, it is necessary to keep the compression rate of 
the coded data to less than the maximum data transfer rate of the recording medium. In addition, if the 
recording time for a given recordable capacity is uniformly determined when recording images to a 

60 recording medium, it is also necessary to control the average transfer rate of the coded data. One means of 
controlling the coding rate is to maintain a constant average coding rate in each GOP. Specifically, as 
shown in Rg. 3A, a constant data amount is allocated to all GOPs in the input image. 

To control the coding rate in the GOP, it is possible, for example, to provide a buffer at the output stage 
of the coding means, control the quantization pitches according to the amount of untransferred code in the 

55 buffer, and thereby control the data amount. Virtual buffers of differing capacities may also be created 
according to the type of the coding method in each frame, and the data amount controlled by these virtual 
buffers. This is because the amount of code required to obtain the same image quality increases according 
to the coding type (i.e.. I.> P > B). and this can therefore be used to change the size of the viilual buffers 
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according to the type of frame processing, thereby preventing the buffer capacity from being too large or 
too small. 

Fig. 4 is a block diagram of a conventional moving picture coding apparatus. As shown in Fig. 4. this 
moving picture coding apparatus comprises an image input means 400 for receiving image signal such as 

5 shown in Fig. 1 (frames shown in Fig. 1 are not yet compressed); a frame locator 401 for setting a pattern 
of alignment of I. P and B frames and setting the number of frames to be included in each GOP; a frame 
processing sequence controller 402 for changing the sequence of the frames according to the frame 
location information output from the frame locator 401 and for producing Image signal such as shown in Fig. 
2; a frame memory 412 having a capacity for storing at least two frames for temporarily holding the frame 

TO data that has to be shifted to a position in later sequence; a motion vector detector 403 for detecting in 
macro block units (e.g.. 16x16 pixels) the motion vector between the newly received frame for processing 
(the "process frame") and the already-prpcessed frame{s) used as the predictive frame of the process 
frame; a subtracter 404 for obtaining the difference between each block of the process frame and the 
predictive frame; a discrete cosine transform (DCT) unit 405 for applying a discrete cosine transformation 

76 (one type of orthogonal transformation) to the differencok, values; a quantizer 406 for quantizing the 
conversion coefficient obtained by the DCT unit 405, and also for producing a compressed frame signal; a 
coding unit 407 for coding (e.g.. by Huffman coding) the compressed frame signal; a data amount controller 
408 for controlling the coding of each frame in accordance with the frame type (I. P. B) data as obtained 
from the frame locator 401, and the quantization pitches based on the data amount generated by the coding 

20 unit 407 to maintain the instantaneous coded amount to be less than a predetermined maximum level; a 
dequantizer 409 and a DCT inverter 410 for temporarily expanding the compressed frame signal; and a 
frame memory 411 for storing the expanded frames. 

The operation of the moving picture coding apparatus shown in Fig. 4 when coding with the frame 
coding sequence shown in Fig. 1 is described in detail below. 

25 First, the frame processing sequence controller 402 passes frame 1-0 to the DCT unit 405. Because 
frame 1-0 is intra-framei codefd. the motion vector detector 403 and subtracter 404 do not operate. The DCT 
unit 405 applies OCT processing by block unit (e.g.. 8 x 8 pixels) to convert the signal to 8x8 matrix data 
expressed in the frequency domain. The quantizer 406 then quantizes the 8x8 matrix data using quantiza- 
tion tables such as shown in Fig. 5 for quantizing each value in the 8x8 matrix block unit. For example, 

30 using the table shown in Rg. 5. the first row first column data in the 8x8 matrix block unit is quantized as 0 
when the data is between 0 and 7; as 1 when the data is between 8 and 15; as 2 when the data is between 
16 and 17. and so on. In other words, the first row first column data is divided by 8 and rounded to obtain 
the quantized value. 

In general, there is a strong correlation between adjacent image frames, and the energy is therefore 
'35 concentrated in the low frequency component. Therefore, as shown in Rg. 5, the quantization pitches are 
made small in the low frequency components and larger in the high frequency components. The quantized 
coefficients are entropy coded by the coding unit 407, and the coded data is output from the coding unit 
407. The data amount controller 408 controls the quantization pitches based on the frame type (I, P or B) 
and the instantaneous amount of coded data generated by the coding unit 407. and applies this information 
,40 .to the quantizer 406. For exarpple. when the frame type is frame I. table shown in;Fig. 5 is used, but when 
the frame type is frame P or frame B. the table shown in Fig. 6 is used. The target data amount of each 
frame in this case is calculated frpnri the targeted average coding rate of the overall image, the number of 
frames in the GOP. and. the coding method of the Jrames in the GOP. . For example, the target data amount 
of frame I can be obtained from equation (1) 

45 

Rate*(FrameGOP/FrameRate)*(l__ratio/(l_ratio*l_frame + P_ratio*P_frame + B_ratio*l_Frame)) (1) 

where Rate (bit/second) is the coding rate of the overall image; FrameRate (frames/second) is the frame 
rate; FrameGOP is the number of frames in each GOP; l_frame is the number of I frames in each GOP; 
50 P_frame is the number of P frames. in each GOP; B_frame is the number of 8 frames in each GOP; and. 

I ratio:P_ratio:B ratio is the ratio of I, P. and B frame code. 

The target data amount of frames P and B can be similarly obtained from equations (2) and (3): 

Rate*(FrameGOP/FrameRate)*(P_ratio/(l_ratio*l_frame + P_ratio'P_frame + B_ratio*l_Frame)) (2) 
55 Rate*(FrameGOP/FrameRate)*(B_ratio/(l_ratio*l_frame + P_ratio*P_frame + B_ratio*l_Frame)) (3) 

The data amount ratio (I ratioiP ratio:B ratio) of each of I. P. and B frames may be controlled 

constantly for the entire input image, or the generated code ratio may be inherited by calculation based on 
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the data amount of each frame generated during actual coding of the previous GOP (e.g., the preceding 
group on the time base). 

The quantizer 406 calculates a new quantizer from the quantization table shown in Fig. 5 and the 
quantization pitches applied from the data amount controller 408, and quantizes each block. Fig. 6 shows 
the quantizer newly calculated by the quantizer 406 when the quantization pitch output from the data 
amount controller 408 is doubled. 

Each compressed frame signal is expanded by dequantizer 409 and OCT inverter 410. More specifi- 
cally, block coefficient quantized by the quantizer 406 is then dequantized by the dequantizer 409. the DCT 
operation is reversed by the DCT inverter 410, and the data is buffered to the frame memory 411 capable 
of storing two frame data. The buffered frame is used as the predictive frame in the next processing 
operation. 

Frame P-3 is then read by the frame processing sequence controller 402. Because frame P-3 is a 
predictive frame using frame 1-0 for the prediction, frame 1-0 is read from the frame memory 411, and the 
motion vector between frame 1-0 and frame P-3 is calculated by macro block unit (e.g., 16 x 16 pixels). 
Motion compensation is accomplished by the subtracter 404 u^ing the motion vector calculated for each 
macro block, and the difference values between macro blocks are obtained. The DCT unit 405 applies DCT 
to each block, and the coding unit 407 applies entropy coding. The data amount controller 408 controls the 
quantization pitches based on the frame type, the target data amount calculated from equation (2). and the 
instantaneous amount of code generated by the coding unit 407, and applies this information to the 
quantizer 406. Each block coefficient quantized by the quantizer 406 is then dequantized by the dequantizer 
409. the DCT operation is reversed by the DCT inverter 410. the motion vector between frame P-3 and 
frame 1-0 is referenced and added to the block unit, and the data Is buffered to the frame memory 411. The 
buffered frame is used as the predictive frame in the next processing operation. Coding thus proceeds 
according to the information from the frame locator 401 . 

With the conventional coding method thus described, however, there are problems as follows. 

(1) The image quality may differ greatly between scenes containing significant motion or scene changes 
and scenes with relatively little motion or change, and there will also be severe Image deterioration at 
scene changes, because the data amount assigned to each GOP is constant irrespective of the scene 
content. 

(2) Image quality within single GOPs may also vary because the data amount assigned to each frame in 
the GOP is fixed or calculated from the data amount ratio between the present and previous GOPs. 

SUMMARY OF THE INVENTION 

35 Therefore, an object of the present invention, which relates to a coding miethod using ttie correlation 
between image frames and fields, is to suppress the variations in image quality resulting frorri differences in 
scene content, including scenes containing significant motion or scene changes and scenes with relatively 
little motion or change, and to Improve the coding efficiency. 

To achieve the aforementioned object, a moving picture coding metthod according to the present 
40 invention for compressing moving picture video signal to a tai'get amount "TARGET" corhprises the steps 
Of:- - ■■ ■ - ' ■ ' ■ 

(I) operating a first cycle operation, said first cycle operation comprising the steps of: 

(a) compressing said moving picture video signal with reference to a constiant compression reference 
value; 

45 (b) counting compressed data amount "GOP(i)" in each GOP; 

(c) counting compressed data amount "Frame(j)" in each frame; 

(d) counting compressed data amount "GOP Total" in total GOPs; 

(e) calculating a target data amount "TARGET_GOP(i)" for each GOP by a following equation (i), 

50 TARGET_GOP(i) « TARGET*(GOP(i)/GOP_Total) (i); ' 

and 

(f) calculating a target data amount "TARGET Frame(j)" for each frame in respective GOP by a 

following equation (ii). 

55 

TARGET_Frame(j) « TARGET_GOP(i)*Frame(j)/GOP(i) (ii); 

and 
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(II) operating a second cycle operation, said second cycle operation comprising the steps of: 

(g) compressing said moving picture video signal with reference to a variable compression reference 

value which is relative to said target data amount "TARGET Frame{j)". 

Also, according to the present invention, a moving picture coding method for compressing moving 
5 picture video signal to a target amount "TARGET" comprises the steps of: 

(I) operating a first cycle operation, said first cycle operation comprising the steps of: 

(a) compressing said moving picture video signal with reference to a constant compression reference 
value, 

(b) counting compressed data amount "GOP(i)" in each GOP; 
10 (c) counting compressed data amount "FrameQ)" in each frame; 

(d) counting a frame number "FrameGOP(i)" in each GOP; 

(d) counting a total frame number "FrameTOTAL" in total GOPs; 

(e) calculating a target data amount "TARGET GOP(i)" for each GOP by a following equation (iii), 

75 TARGET_GOP(i) « TARGET(FrameGpP(i)/FrameTotal) (iii); 

and 

(f) calculating a target data amount "TARGET FrameO)" for each frame in respective GOP by a 

following equation (ii); 

20 . . 

TARGET_Frame(j) « TARGET_GOP(i)*FrameO)/GOP(i) (ii); 

and 

(II) operating a second cycle operation, said second cycle operation comprising the steps of: 

25 (g) compressing said moving picture video signal with reference to a variable compression reference 

value which is relative to said target data amount "TARGET_Frame{j)". 

Furthermore, according to the present invention, a moving picture coding apparatus for compressing 
moving picture video signal to a target amount "TARGET" comprises: 

compressing means for compressing said moving picture video signal; 
30 constant generator means for generating a constant compression reference value; 

first counting means for counting compressed data amount "GOP(i)" in each GOP; 

second counting means for counting compressed data amount "FrameG)" »n each frame; 

third counting means for counting compressed data amount "GOP Total" in total GOPs; 

first calculating means for calculating a target data amount "TARGET__GOP(i)" for each GOP by a 
35 following equation (i), 

TARGET^GOP(i) « TARGET*(GOP(i)/GOP_Total) " (i); 

second calculating means for calculating a target data amount "TARGET_^Frame(j)" for each frame in 
40 respective GOP by a following equation, (it), \ . 

TARGET__Frame(j) « TARGET__GOP0)*Frame(j)/GOP(i) (ii); 

and 

45 switching means for switching between a first position during a first cycle operation for compressing 
said moving picture video signal with the use of said constant compression reference value and a second 
position during a second cycle operation for compressing said moving picture video signal with the use of 

said target data amount "TARGET Frame(j)" as the compression reference value, said first position 

acquired when said constant generator means is connected to said compressing means and, at the same 
50 time, an output of said compressing means is connected to said first, second and third counting means, and 
said second position acquired when said second calculating means Is connected to said compressing 
means and, at the same time, an output of said compressing means Is connected to a recording rriedium. 

Still furthermore, according to the present invention, a moving picture coding apparatus for compressing 
moving picture video signal to a target amount "TARGET" comprises: 
55 compressing means for compressing said moving picture video signal; 

constant generator means for generating a constant compression reference value; 
first counting means for counting compressed data amount "GOP(i)" in each GOP; 
second counting means for counting compressed data amount "Frame(j)" in each frame; 
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third counting means for counting a frame number "FrameGOP(i)" in each GOP; 
fourth counting means for counting a total frame number "FrameTOTAL" in total GOPs; 
first calculating means calculating a target data amount "TARGET_GOP(l)" for each GOP by a 
following equation (iii), 

5 

TARGET__GOP(i) « TARGET(FrameGOP(i)/FrameTotal) (iii); 

second calculating means for calculating a target data amount "TARGET Frame(j)" for each frame in 

respective GOP by a following equation (ii), 

70 

TARGET__Frame(j) « TARGET__GOP(irFrameG)/GOP(i) (ii); 

and 

switching means for switching between a first position during a first cycle operation for compressing 
75 said moving picture video signal with the use of said constant compression reference value and a second 
position during a second cycle operation for compressing said moving picture video signal with the use of 
said target data amount "TARGET__FrameO)" as the compression reference value, said first position 
acquired when said constant generator means is connected to said compressing means and, at the same 
time, an output of said compressing means is connected to said first, second and third counting means, and 
20 said second position acquired when said second calculating means is connected to said compressing 
means and, at the same time, an output of said compressing means is connected to a recording medium. 

As described above, a coding method and coding apparatus according to the present invention can 
allocate the data amount according to the features of the input image while varying the data amount 
allocated to each GOP and the data amount allocated to each frame according to the scene content. It is 
25. therefore .possible to suppress the variation in image quality resulting from differences in scene content, 
specifically differences in image quality between scenes containing significant movement or scene changes 
and scenes containing little or no movement. It is also possible to minimize the image deterioration 
occurring at scene changes. 

30 BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will b<ecome more fully understood from the detailed description given below and 
the accompanying diagrams wherein: 

Fig. 1 Is a diagram showing the frame coding method of the prior art; 
35 Fig. 2 is a diagram showing a method of dividing the frames into GOPs; 

Figs. 3A and 3B are graphs showing the target data amount of each GOP and each franne; 

Fig. 4 is a block diagram of a coding apparatus according to the prior art; 

Figs. 5 and 6 are diagrams showing quantization tables used in the coding apparatus of Fig. 4; 

Fig: 7 is a block diagram of a coding apparatus according to the present invention; 
40 Figs. 8i 9, 10, 11 and 12 are diagrams showing various frame coding methods employed in the 

apparatus of Fig. 7; 

* Figs. 13 and 14 are diagrams showing methods of dividing the frames into GOPs employed in the 
apparatus of Fig. 7; 

Fig. 15 is a graph used to describe the data amount generated for each GOP; 
45 Rgs. ISA. 16B. 16C. 17A, 176 and 18 are diagrams showing possible quantization tables used in the 
coding apparatus of Rg. 7; and 

Fig. 19 is a graph used to describe the data amount generated tor each GOP. 

DESCRIPTION OF PREFERRED EMBODIMENTS 

50" ■ •■ * ' : 

the preferred embodiments of the present invention are described below with reference to the 
accompanying figures. 

Referring to Fig. 7 a block diagram of a coding apparatus according to the preferred embodiment of the 
present invention is shown. 

55 The moving picture coding apparatus according to the present invention comprises an image input 
means 400 for receiving image signal such as shown in any one of Fig. 8, 9, 10, 11 and 12 (frames shown 
in these figures are not yet compressed); a frame locator 401 for setting a pattern of alignment of I, P and B 
frames and setting the number of frames to be included in each GOP; a frame processing sequence 
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controller 402 for changing the sequence of the frames according to the frame location information output 
from the frame locator 401 and for producing image signal such as shown in Fig. 13 or 14; a frame memory 
412 having a capacity for storing al least two frames for temporarily holding the frame data that has to be 
shifted to a position in later sequence; a motion vector detector 403 for detecting in macro block unils (e.g., 

5 16x16 pixels) the motion vector between the newly received frame for processing (the "process frame") 
and the already-processed frame(s) used as the predictive frame of the process frame; a subtracter 404 for 
obtaining the difference between each block of the process frame and the predictive frame; a discrete 
cosine transform (DCT) unit 405 for applying a discrete cosine transformation (one type of orthogonal 
transfornnation) to the difference values; a quantizer 406 for quantizing the conversion coefficient obtained 

10 by the DCT unit 405 , and also for producing a compressed frame signal; a coding unit 407 for coding (e.g., 
by Huffman coding) the compressed frame signal; a data amount controller 408' for controlling the coding 
of each frame in accordance with the frame type (I, P, B) data as obtained from the frame locator 401 , and 
the quantization pitches based on the data amount generated by the coding unit 407 to maintain the 
instantaneous coded amount to be less than a predetermined maximum level; a dequantizer 409 and a DCT 

IS inverter 410 for temporarily expanding the compressed franje signal; and a frame memory 411 for storing 
the expanded frames. 

The above arrangement except for the data amount controller 408' is substantially the same as those 
described above in connection with Fig. 4. 

The moving picture coding apparatus according to the present invention further comprises: a switch 

20 SW1 connected to the coding unit 407 and a switch SW2 connected to the quantizer 406 which are 
simultaneously turned to a real line position during a first cycle opei-ation to obtain actual coded data 
amount of the entire signal to be recorded on one disc under a constant compression reference value, and 
turned to a dotted line position during a second cycle operation for changing the compressing rate by 
making reference to the data obtained in the first cycle operation such that the compression rate is 

25 increased where the plain pictures are present and decreased where the complicated pictures are present; 
a frame data amount counter 701 for counting the compressed data amount in each frame: a GOP data 
amount counter 702 for counting the compressed data amount in each GOP; a frame table memory 703 for 
storing amount of data in each of all the frames to be recorded on one disc; a GOP table memory 704 for 
storing amount of data in each of all the GOPs to be recorded on one disc; a target GOP amount calculator 

30 706 for calculating a target data amount for each of all the GOPs to be recorded on one disc; a target frame 
amount calculator 705 for calculating a target data amount for each of all the frames to be recorded on one 
disc; a constant data generator 708 for providing a constant cohnpression reference value K to the quantizer 
406 during the first cycle operation; and a pick-up drive 707 for recording the efficiently compressed coded 
data obtairied in the second cycle operation to a. disc. Instead of the target GOP amount calculator 706, a 

35 target GOP amount calculator 709 may be provided. 

In operation, during the first cycle operation, switches SW1 and SW2 are turned to the real line position 
so that the quantizer 406 receives the constant value K from constant generator 708, and the coded data is 
sequentially applied to frame data amount counter 701 and to GOP data amount counter 702. During the 
first cyc|e operation, full complete video data to be recorded on the disc, such as 130 minutes long video 

40 data, is applied from the very beginning to input 400, During the firsft cycle, operation, the quantizer 406. is 
quantized using a constant value K: Frame data amount counter 701 counts the amount of coded data in 
each frame in the 130 minutes long video data, and the GOP data aniount counter 702 counts the amount 
of coded data in each GOP in the 130 minutes long, video data. The counted results are stored in frame 
table memory 703 and GOP table memory 704. respectively. 

45 Rg. 15 shows an example how the counted GOP data amount varies for different GOPs, and Fig. 19 
shows an example how the counted frame data amount varies for different frames. In Rg. 15. if the same 
amount of area is allocated on the disc for storing different GOPs, it is apparent that some GOPs may not 
use the full allocated amount of area on the disc, resulting in less effective use of the disc. As apparent 
from the further description, the coding apparatus of the present invention provides wider area of recording 

50 for the GOPs that have larger amount of data, and provides smaller area of recording for the GOPs that 

have smaller amount of data. A similar thing can be said to the frames. 

Since there are 30 frames in one second, the total frames in 130 minutes will be 130x60x30 frames. 
Since it takes about 4 bytes to indicate the amount of coded data in each frame, the frame table memory 
703 has a memory size of atxiut 130x60x30x4 bytes. Also, if there are about 15 frames in each GOP, the 

55 GOP table memory 704 has a mernory size of about 130x60x30x4/15 bytes. 

In the target GOP amount calculator 706, the target data amount TARGET_GOP(i) for GOP / can be 
calculated from equation (4), 
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TARGET__GOP{i) = TARGET-(GOP(i)/GOP_Total) (4) 

where GOP(i) is the counted data amount in GOP /; GOP Total is the total data annount for alt GOPs, i.e., 

the total coded data amount in 130 minutes video signal obtained in the first cycle operation; and 'TARGET* 

5 is maximum capacity of data that can be stored in the disc. Thus, it can be said that the target data amount 

TARGET GOP(i) is the maximum allocated area in the disc for storing the coded data for GOP /. It is 

understood to those skilled in the art that the target data amount TARGET GOP(i) is proportional to the 

counted data amount GOP(i). 

According to a modification, instead of the target GOP amount calculator 706, the target GOP amount 

10 calculator 709 may be used. In this case, the target data amount TARGET GOP(i) for GOP / can be 

calculated from equation (5). 

TARGET_GOP(i) = TARGET*(FrameGOP(i)/FrameTotal) (5) 

76 where FrameGOP(i) is the number of frames in GOP /; FramaTotal is the total number of frames in total 
video signal to be recorded; and 'TARGET is maximum capacity of data that can be stored in the disc- 
In the target GOP amount calculator 706. it is also possible to calculate the TARGET GOP(i) by the 

following equation (6). 

20 TARGET_GOP(i) = TARGET*(GOP{i)/GOP__Total) *WtGOP(i) (6) 

where \AftGOP(i) is the weighting value for GOP /. 

In the target GOP annount calculator 709. it is also possible to calculate the TARGET_GOP(i) by the 
following equation (7). 

25 

TARGET_GOP(i) = TARGET*(FrameGOP(i)/FrameTotai) *WtGOP(i)) (7) 

where WtGOP(i) is the weighting value for GOP /. 

To calculate the weighting value of the GOP, the percentage of still innage area, the percentage of 

30 moving image area, and the magnitude of the motion vector in the moving image area are calculated in 
each GOP, and these calculated values are then used to calculate the weighting value. For example, if an 
objective is to maintain the image quality of the still image area and the percentage of the still image area 
to the total image area is high, the weighting can be set high; if the objectiviB is to maintain the image 
quality in the moving picture area and the percentage of the moving picture area to the total image area is 

35 high, the weighting of the nioving picture area can be set high. More efficient control based oh the actual 
amount of image movernent detected is also possible by using this vector information. 

In target frame iamount calculator 705, the target data amount TARGET_Frame(j) for the frame J in 
GOP / can be calculated from equation (8). 

40 TARGET_FrameO); == tARGET_GOP(i)Trarne(j)/GOP(l) (8) 

whei'e FrameO) is the counted data amount in irafhe j. It Is understood to those skilled in the art that the 
target data amount TARGET_Frame(j) is proportional to the counted data amount FrameO). 

In target frame amotjnt calculator 705. it is also possible to cialculate the TARGET Frame(j) by the 

45 following equation (9), 

TARGET_FrameO) = TARGET_GOP{irFramea)/GOP(i) "WtFrame(j) (9) 

where WtFrameG) is the weighting value for frame / 

50 To calculate the weighting value of each frame, the percentage of still image area, the percentage of 
moving image area, and the magnitude of the motion vector in the moving image area are calculated in 
each frame, and these calculated values are then used to calculate the weighting value. For example, if an 
objective is to maintain the image quality of the still image area and the percentage of the still image area 
to the total image area is high, the weighting can be set high; if the objective Is to maintain the image 

55 quality in the moving picture area and the percentage of the rhoving pictui^e area to the total image area is 
high, the weighting of the moving picture area can be set high. More efficient control based on the actual 
amount of image movement detected is also possible by using this vector information. 
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The calculated target data amount TARGET_FrameO) may be stored in a memory (not shown) for use 
in the second cycle operation, or such target data amount TARGET_Frame(j) can be calculated in the 
second cycle of operation but before processing the frame y. 

When the above first cycle operation completes, the switches SW1 and SW2 are turned to the position 
5 shown by the dotted lines, and the same 130 minutes long video signal is applied to the input 400 from the 
very t>eginning. 

In this case, the data amount control 408* further receives the target data amount TARGET Frame{j) 

from the target frame amount calculator 705. As apparent from the above, the target data amount 

TARGET FrameO) is relatively large when the pictures in the video signal vary greatly with respect to time, 

10 that is when there is less time base correlations, and it is relatively small when the pictures in the video 
signal vary slowly with respect to time, that is when there is great time base correlations. When the target 
data amount TARGET_Frame(j) is large, the data amount control 408* controls quantizer 406 to quantize 
with small size quanta, resulting in detail data quantization. In this case, the bit rate of the bit stream as 
produced from the coding unit 407 will be at a high bit rate. On the other hand, when the target data 

75 amount TARGET FrameO) is small, the data amount control 408* controls quantizer 406 to quantize with 

large size quanta, resulting in rough data quantization. In This case, the bit rate of the bit stream as 
produced from the coding unit 407 will be at a low bit rate. 

Thus, the image is coded by controlling the data amount for each frame to the target data amount. It is 
therefore possible to code the moving picture image using a data amount allocation determined according 
20 to the features of each scene, 

A detail of the data amount control 408* and quantizer 406 is disclosed in "INTERNATIONAL 
ORGANISATION FOR STANDARDISATION ISO-IEC/JTC1/SC29AA/G1 1 CODED REPRESENTATION OF 
PICTURE AND AUDIO INFORMATION" CCITT SG XV Working Party XV/1 Experts group on ATM Video 
Coding, Issued July 31, 1992, particularly in a section titled "Test Model 2" on pages 56-59 thereof; the 
25 entire content of which is expressly incorporated by reference herein. 

The bit stream of 130 minutes coded video data as produced from the coding unit 407 is applied to the 
pick-up drive 707 and sequentially written on the disc using its full capacity. Accordingly, the recorded 
coded video data can present much clear and detail pictures than the single cycle recording method. 

In the coding apparatus of the present invention, it is possible to use various coding methods, as 
30 explained below. 

One coding method is intra-frame coding using only data correlations within each frame. This is 
illustrated in Rg. 8 where each frame I is an intra-frame coded frame and the number following the I 
indicates the frame number within the frame sequence. 

Another coding method combines intra-frame coding using only data congelations within each frame and 
35 inter-frame, coding using the preceding frame(s) as the predictive frames, for the inter-frame coded frames. 
This is illustrated in Rg. 9 wherein frames I and frames P are used. Note also that in the method shown in 
Fig. 9 GOPs comprising four frames in an l-P-P-P configuration (the intra-frame coded frames I occur every 
fourth frame) are gisnerated, but the interval at which frames I occur may vary. 

Yet another coding method .generates GOPs comprising ,|-picture frames. P-picture frames and B- 
40 picture frames. This is shown in Rg. 10. The basic GOP configuration in this method is BBIBBP (vvhere 
frames 1 occur every six frames and frames P occur every three frames), but other intervals for frames I and 
P may be used. . , 

Another coding method generates GOPs comprising l-picture odd fields, l-picture even fields, P-picture 
odd fields, and P-picture even fields. This is shown in Fig. 11. The basic GOP configuration in this method 
45 is IPPP (where frames I occur eyery four frames), but other frame I intervals may be used. 

Yet another coding method generates GOPs comprising l-picture odd fields, l-picture even fields. P- 
picture odd fields. P-picture even fields B-picture odd fields, and B-picture even fields. This is shown in Rg. 
12. The basic GOP configuration in this method is BBIBBP (where frames I occur every six frames and 
frames P occur every three frames), but other intervals for frames I and P may be used. 
50 In the coding apparatus of the present invention, it is possible to use various methods of dividing the 
moving picture image into GOPs is to allocate the same number of frames to each GOP, as explained 
below. 

One method of dividing the moving picture image into GOPs Is to allocate the same number of frames 
to each GOP. For example, the number of frames in. each GOP shown in Rg. 13 is six. In this case, 
55 however, the first GOP has fewer B frames (only two in this example) than the other GOPs. The advantage 
of this GOP allocation method is that, because there are the same number of frames in each GOP. time 
base control is easier when image control referenced to the t'me base is necessary during random data 
access or image editing, for example. In addition, the number of frames allocated to each GOP can be 
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freely controlled by the application software. This is essentially a trade-off between the access unit and 
image quality (compression efficiency). In applications requiring a small access unit, e.g.. during editing, a 
smaller number of frames in each GOP reduces the editing unit (time), and enables more precise editor 
control. The trade-off in this case is that a certain degree of compression efficiency is lost. 

5 Another method of dividing the moving picture image Into GOPs is to allocate a variable number of 

frames to each GOP. In Fig. 14. for example, a different number of frames is allocated to each of the GOPs 
shown. An effective allocation method in this case is to assign frames with a strong mutual correlation to the 
same GOP. In this case the coding method uses the correlation between frames in the GOP, and can 
generally achieve greater compression efficiency compared with methods assigning a fixed number of 

10 frames to each GOP. In other words, image quality can be improved if the data arhount remains constant. 
This method is therefore more effective in applications for which image quality is critical and access by 
GOP or frame unit is not as important. 

Furthermore, according to the coding apparatus of the present invention. It is possible to use a different 
quantizer for different type of coding methods. For the quantizers, quantization tables which differ according 

15 to the frame type as shown in Fig. 16A, 16B and 160 mayS^e used. In this case, different quantization 
tables are used for frames I, P and B. The tables may be defined to obtain the same image quality for each 
frame processing type when the same quantization pitch is used for each frame processing type. 

Another method of defining the quantization tables is shown in Fig. 17A and 178 wherein two different 
quantization tables are used. In this case the different quantization tables are used for frames I and for 

20 frames P and B. It should be noted that these quantization tables are also defined to obtain the same image 
quality for each frame processing type when the same quantization pitch is used for each frame processing 
type- 
Note that it is also possible to define only a single quantization table as shown in Fig. 18. 
The invention being thus described, it will be obvious that the same may be varied in many ways. Such 

25 variations are not to be regarded as a departure from the spirit and scope of the invention, and all such 
modifications as would be obvious to one skilled in the art are intended to be included within the scope of 
the following claims. 



30 



Claims 



1. A moving picture coding method for compressing moving picture video signal to a target amount 
"TARGET", said moving picture video signal being divided into a plurality of groups of pictures 
(GOPs). each GOP comprising a plurality of frames, said method comprising the steps of: 

(I) operating a first cycle operation, said first cycle operation comprising the steps of: 

35 (a) compressing said moving picture video signal with reference to a constant compression 

reference value; 

(b) counting compressed data amount "GOP(i)" in each GOP; 

(c) counting compressed data amount "FrameO)" in each frame; 

(d) counting compressed data amount "GOP___Totar In total GOPs; 

40 (e) calculating a target data amounV "TARGET GOP(i)" for ieach GOP by a following equation (i). 

TARGET_GbP(i) « TARGET*(GOP(i)/(30P_Total) (i); 

and . 

45 (f) calculating a target data amount "TARGET_Frame(j)" for each frame in respective GOP by a 

following equation 

TARGET__FrameO) « TARGET_GOP(irFramea)/GOP(i) (ii); 

50 and 

(II) operating a second cycle operation, said second cycle operation comprising the steps of: 

(g) compressing said moving picture video signal with reference to a variable compression 
reference value which is relative to said target data amount TARGET_Frame(j)". 

55 2. A moving picture coding method as claimed in Claim 1, wherein said moving picture video signal is 
compressed by using intra-frame correlations. 
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3. A moving picture coding method as claimed in Claim 2. wherein said moving picture video signal is 
compressed by further using inter-frame correlations. 

4. A moving picture coding method as claimed in Claim 2. wherein said moving picture video signal is 
compressed by further using inter-field correlations. 

5. A moving picture coding method as claimed In Claim 1, wherein said equation (i) is given as follows: 

TARGET_GOP(i) = TARGE"r(GOP(i)/GOP_Total) (j*). 



6. A moving picture coding method as claimed in Claim 1. wherein said equation (I) is given as follows: 

TARGET_GOP(l) = TARGET-(GOP(i)/GOP_Totair WtGOP(i) (i") 
in which WtGOP(i) is the weighting value for the corresponding GOP. 

7. A moving picture coding method as claimed in Claim 1. wherein said equation (ii) is given as follows: 

TARGET_FrameG) = TARGET_GOP(i)-Frame(j)/GOP(l) (11'). 

8. A moving picture coding method as claimed in Claim 1. wherein said equation (11) is given as follows: 

TARGET_Frame(j) = TARGET__GOP(i)Trame(j)/GOP(i) /WtFrameO) (ii") 
where WtFrame(i) »s the weighting value for the corresponding frame. 

9. A moving picture coding method for compressing moving picture video signal to a target amount 
"TARGET", said moving picture video signal being divided Into a plurality of groups of pictures 
(GOPs). each GOP comprising a plurality of frames, said method comprising the steps of: 

(I) operating a first cycle operation, said first cycle operation comprising the steps of: 

(a) compressing said moving picture video signal with reference to a constant compression 
reference value, 

(b) counting compressed data amount "GOP(I)" in each GOP; 

(c) counting compressed data amount "FrameO)" in each frame; 

(d) counting a frame number "FrameGOP(l)" In each GOP; " 

(d) counting a total frame number "FrameTOTAL" in total GOPs; 

(e) calculating a target data amount "TARGET_GOP(l)" for each GOP by a following equation 
(iii). ^ - 

TARGET_^GOP(i).oc TARGET*(FrameGOP(i)/FrameTotal) (Hi); 

and 

(0 calculating a target data amount "TARGET_FrameO)" for each frame In respective GOP by a 
following equation (ii), 

TARGET_Frame(j) « TARGET_GOP(i)Tramea)/GOP(i) (11); 

and , . __ ^ . _ . - 

(II) operating a second cycle operation, said second cycle operation comprising the steps of: 

(g) compressing said moving picture video signal with reference to a variable compression 
reference value which is relative to said target data amount "TARGET_Frame(j)". 

10. A rhoving picture coding method as claimed In Claim 9. wherein said moving picture video signal is 
compressed by using intra-frame correlations. 
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11. A moving picture coding nnethod as claimed in Claim 9, wherein said moving picture video signal is 
compressed by further using inter-frame correlations. 

12. A moving picture coding method as claimed in Claim 11, wherein said moving picture video signal is 
5 compressed by further using inter-field correlations. 

13. A moving picture coding method as claimed in Claim 9, wherein said equation (iil) is given as follows: 

TARGET_GOP(i) = TARGErFrameGOP(i)/FrameTotal (iii'). 



14. A moving picture coding method as claimed in Claim 9. wherein said equation (iii) is given as follows: 
TARGET_GOP(i) = TARGET(FrameGOP(i)/FrameTotal) *WtGOP(i) (iii") 

IS 

in which WtGOP(i) Is the weighting value for the corresponding GOP. 
15- A moving picture coding method as claimed in Claim 9, wherein said equation (ii) is given as follows: 
20 TARGET_Frame(j) = TARGET_GOP(irFramea)/GOP(i) (ii'). 



16. A moving picture coding method as claimed in Claim 1, wherein said equation (ii) is given as follows: 
25 TARGET_Framea) = TARGET_GOP(i)Tramea)/GOP(i) -WtFrameO) (ii") 

where WtFrame(j) is the weighting value for the corresponding frame. 

17. A moving picture coding apparatus for compressing rhoving picture video signal to a target amount 
30 "TARGET", said moving picture video signal being divided into a plurality of groups of pictures 

(GOPs), each GOP comprising a plurality of frames, said apparatus comprising: 

compressing means (401 -407) for compressing said moving picture video signal; 

constant generator means (708) for generating a constant compression reference value; 

first counting means (702) for counting compressed data amount "GOP(i)" in each GOP; 
35 second counting means (701) for counting compressed data amount "Framed)" in each frame; 

third counting means (702) for counting compressed data amount "GOP^ ^Total" in4otal GOPs; 

first calculating means (706) for calculating a target data amount "TARGET GOP(i)" for each GOP 

by a following equation (i), 

40 TARGET_GOP(i) oc TARGEr(GOP(i)/GOP_Total) (i); 

second calculating means (705) for calculating a target data amount "TARGET Frame{j)" for each 

frame in respective GOP by a following equation (ii). 

45 TARGET_Frame(j) « TARGET_GOP(l)TrameO)/GOP(i) C"); 

and 

switching means (SW1 . SW2) for switching between a first position during a first cycle operation for 
compressing said moving picture video signal with the use of said constant compression reference 

50 value and a second position during a second cycle operation for compressing said moving picture * 
video signal with the use of said target data amount *TARGET_FrameO)" as the compression 
reference value, said first position acquired when said constant generator means is connected to said 
compressing means and, at the same time, an output of said compressing means is connected to said 
first, second and third counting means, and said second position acquired when said second calculating 

55 means is connected to said compressing means and, at this same time, an output of said compressing 

means is connected to a recording medium. 
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ia A moving picture coding apparatus as claimed in Claim 17, wherein said equation (i) is given as follows: 
TARGET_GOP(i) = TARGET-(GOP(i)/GOP__Total) (i'). 

5 

19. A moving picture coding apparatus as claimed in Claim 17, wherein said equation (i) is given as follows: 

TARGET_GOP(i) = TARGET*(GOP(i)/GOP__Totair WtGOP(i) (i") 
70 in which WtGOP(i) is the weighting value for the corresponding GOP. 

20. A moving picture coding apparatus as claimed in Claim 17. wherein said equation (li) is given as 
follows: 

75 TARGET__Frame{j) = TARGET__GOR(i)*Frame(j)/GOP(i) (ii'). 



picture coding apparatus as claimed in Claim 17, wherein said equation (ii) is given as 



TARGET_Framea) = TARGET__GOP(i)*Frame(j)/GOP(i) *WtFrame(j) (ii") 
where WtFrame(j) is the weighting value for the corresponding frame. 

A moving picture coding apparatus as claimed in Claim 17. wherein said compressing means (401-407) 
comprises: 

discrete cosine transform means (405) for applying a discrete cosine transformation to said moving 
picture video signal to produce conversion coefficients; 

quantizer means (406) for quantizing the conversion coefficients obtained by said discrete cosine 
transform means and for producing a compressed frame signal; and 
coding means (407) for coding said compressed frame signal. 

A moving picture coding apparatus as claimed in Claim 22. wherein said moving picture video signal is 
compressed by using intrarframe correlations. 

A moving picture coding apparatus as claimed in Claim 22, wherein said moving picture video signal is 
compressed by further using first and second type inter-frame correlations. 

25. A moving picture coding apparatus as claimed in Claim 24. wherein said quantizer means comprises at 
40 least one quantization tablel 

. 26- A moving picture^coding apparatus as claimed in Claim 24, wherein said quantizer means comprises 
two quantization tables, respectively, for the frames using said intra-frame correlations, and for the 
frames using said inter-frame correlations. 

45 - 

27. A moving picture coding apparatus as claimed in Claim 24, wherein said quantizer means comprises 
three quantization tables, respectively, for the frames using said intra-frame correlations, for the frames 
using said first type inter-frame correlations, and for the frames using said second type inter-frame 

i correlations. 

50 - - - - 

28. A moving picture coding apparatus for compressing moving picture video signal to a target amount 
"TARGET", said moving picture video signal being divided Into a plurality of groups of pictures 
(GOPs). each GOP comprising a plurality of frames, said apparatus comprising: 

compressing means (401-407) for compressing said moving picture video signal; 
55 constant generator means (708) for generating a constant compression reference value; 

first counting means (702) for counting compressed data amount "GOP(i)" In each GOP; 
second counting means (701) for counting compressed data amount "Frame(j)" in each frame; 
third counting rneans (401) for counting a frame number "FrameGOP(l)* in each GOP; 



21. A moving 
follows: 

20 
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fourth counting means (401) for counting a total frame number "FrameTOTAL" in total GOPs; 

first calculating means (709) calculating a target data amount "TARGET GOP(i)" for each GOP by 

a following equation (iii). 

5 TARGET_GOP(i) « TARGET-(FrameGOP(i)/FrameTotal) (iii); 

second calculating means (705) for calculating a target data amount "TARGET FrameG)" ^or each 

frame in respective GOP by a following equation (ii), 

10 TARGET_Frame(j) « TARGET_GOP(i)TrameO)/GOP(i) (ii); 

and 

switching means (SW1 , SW2) for switching between a first position during a first cycle operation for 
compressing said moving picture video signal with the use of said constant compression reference 

75 value and a second position during a second cycle operation for compressing said moving picture 

video signal with the use of said target data amount "TARGET FrameQ)" as the compression 

reference value, said first position acquired when said constant generator means is connected to said 
compressing means and. at the same time, an output of said compressing means is connected to said 
first, second and third counting means, and said second position acquired when said second calculating 

20 means is connected to said compressing means and. at the same time, an output of said compressing 

means is connected to a recording medium. 

29. A moving picture coding apparatus as claimed in Claim 28, wherein said equation (iii) is given as 
follows: 

25 

TARGET_GOP(i) = TARGErFrameGOP(i)/FrameTotal (iii'). 



30. A moving picture coding apparatus as claimed in Claim 28, wherein said equation (iii) is given as 
30 follows: 

TARGET_GOF(i) = TARGET*(FrameGOP(i)/FrameTotal) *WtGOP(i) (iii") 
in which WtGdP(i) is the weighting value for the corresponding GOP. 

35 

31. A moving picture coding apparatus as claimed in Claim 28. wherein said equatiort. (ii) is given as 
follows: 

TARGET__FrameO) = TARGET_GOP(i)'Frame0)/6OP(i) (ii'). 

40 

32. A moving picture coding apparatus as claimed in Claim 28, wherein said equation (ii) is given as 
follows: : 

45 TARGET_Frame(j) = TARGET_GOP(i)*Frame(j)/GOP(i) *WtFrame(j) (ii") 

where WtFrame(j) is the weighting value for the corresponding frame. 

33. A moving picture coding apparatus as claimed . in Claim 28. wherein said compressing means (401-407) 
50 comprises: . , . . . . _ 

discrete cosine transform means (405) for applying a discrete cosine transformation to said moving 
picture video signal to produce conversion coefficients; 

quantizer means (406) for quantizing the conversion coefficients obtained by said discrete cosine 
transform means and for producing a compressed frame signal; and 
65 coding means (407) for coding said compressed frame signal. 

34. A moving picture coding apparatus as claimed in Claim 33. wherein said moving picture video signal is 
compressed by using intra-frame correlations. 
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35. A moving picture coding apparatus as claimed in Claim 34, wherein said moving picture video signal is 
compressed by further using first and. second type inter-frame correlations. 

36. A moving picture coding apparatus as claimed in Claim 35, wherein said quantizer means comprises at 
5 least one quantization table. 

37. A moving picture coding apparatus as claimed in Claim 35, wherein said quantizer means comprises 
two quantization tables, respectively, for the frames using said intra-frame correlations, and for the 
frames using said inter-frame correlations. 
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38. A moving picture coding apparatus as claimed in Claim 35, wherein said quantizer means comprises 
three quantization tables, respectively, for the frames using said intra-frame correlations, for the frames 
using said first type inter-frame correlations, and for the frames using said second type inter-frame 
correlations. 
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